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ABSTRACT 



A., 

/•n 



This thesis coirpared the use of a discrete utterance 
voice recognition system and a keyboard entry device in 
retargeting Air launch Cruise Missiles (ALCM) prior to 
launch from a E-52G aircraft. Time to load, input and 
output accuracies, and time versus accuracy measurements 
were made for each of twenty subjects. Keyboard entry was 
found to be tetter than voice entry in time to load and 
input accuracy. These findings are limited to discrete 
utterance voice recognition systems and most probably would 
have been different if a connected speech recognition system 
had been utilized. 

Also investigated were three display formats for 
presenting flex targeting information on a cathode ray tube. 
Information was updated on the cathode ray tube using 
single-space, double-space, and inverse-video formats. Time 
to update, input and output accuracies, and time versus 
accuracy measurements were recorded. No significant 
differences were found among the three display formats. 
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I. BACKGROUND 



A. INTRODUCTION 

The E-5iiG v*as selected in 1977 to he outfitted with an 
all new navigation and weapons control suite called the 
Offensive Avionics Systerr (GAS). This systerr would control 
and launch the Air Launch Cruise Missile (AlCM). The flight 
crews based at the Boeing Airplane Company, Wichita, Kansas, 



and the 


human factors 


staff 


at Edwards AFB , 


California , 


were 


tasked 


to evaluate the 


OAS . 


Based on conversations 


with 


these 


two groups, 


it 


was discovered 


that the 


ALCM 


retargeting procedure. 


also 


known as 'flex 


targeting" , 


wa s 



slow and cumbersome. 

The purpose of fiei targeting is to give political and 
military leaders greater fleiibility during both strategic 
ana tactical conflicts. In future warfare, the political as 
well as the military situation will be in constant flux. As 
the situation rapidly changes, targets will change as well. 
A commander's ability to change the course of a battle in 
minutes or seconas will oe dependent upon the ability of his 
forces to respona to these sudden changes. This flexibility 
depends upon rapid weapon retargeting which the present OAS 
does not provide. 

One possible solution to this problem was seen in 
computer voice technology. Work in this area of computer 
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voice appiicaiions research is ongoing here ai ihe Naval 
Postgraduate School by Dr. Gary PoocK. If was felt that the 
ALCM flei targeting problem could be easily investigated 
here due to the extensive facilities of the Human Factors 
Laboratory. 

B. OAS/ALCM SYSTEM IN E-52G 

1. Background 

The B-52 bomber has been in the U.S. Air Force 
arsenal since 1954. Seven hundred forty-four aircraft were 
produced through 1962 beginning with model "a" and finishing 
with model ’h’ . Today only three models, the "d" , "g" , and 
"e" remain in service. 

Ail three are assigned nuclear and conventional roles. 
The "d” model, the oldest and least modified of the three, 
is eipectea to be retired within the next two years and be 
replaced by 103 B-IB aircraft. (The USAF has designated the 
cruise-missile-capable B~1 the 'B-IB'. It will be equipped 
with external cruise missile pylons.) 

The "g” and "h" models continue on active duty and are 
the subjects of many modifications to extend their life, 
improve their survivability, and add to the missions they 
are already expected to perform. This paper addresses a 
mission addea recently to the B-52G, which is presently 
undergoing modifications which will allow it to carry the 
Air Launched Cruise Missile ^ALCM). 
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2. Operation 



The ALCM is a small, unmanned, winged air vehicle 
capable of sustained subsonic flight following launch from 
the B-5iiG (see Jigure 1). Propelled hy a turhofan engine, 
it incorporates a nuclear warhead with a variable yield of 
up to 200 kilotoas for a "hard target" kill capability, and 
is programmed to strike a pre-determi red surface target 
[P.ef . 1] . 

While the ALCM is onboard the B-52G, it is receiving 
position, beading, and alti tude information from the 
aircraft's inertial navigation system every 60 seconds [P.ef. 
2]. When the missile is activated for launch, it knows 
where it is and where it is heading. 

Upon launch from the B-62G, ALCM wing deployment is 
attained within two seconds, and engine start within three 
seconds. After launch, position, attitude and velocity 
reference aata are derived from the ALCM's inertial 
navigation system, mach number and pressure altitude from 
the air data system, and height above the terrain from the 
radar altimeter. Initial position/velocity data and 
atmospheric paraneters are transferred to the missile from 
the B-5ZG carrier immediately prior to launch. The missile 
is then guided inertially along preplanned flight profiles 
at programmed Mach numbers and altitudes. Velocity commands 
ere based on precomputed ground speeds required to reach the 
target at a specified time. 
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"Tiine-to-targei" is caiculaied by the computer, and throttle 
ccmmands are issued as required to maintain average ground 
speeds along each trajectory segment. Altitudes are 
selected to be either "altitude hold", where the missile 
flies at a commanded barometric altitude, or "terrain 
following" where the missile flies at a specified height 
above the terrain. 

Guidance is by a combination of an inertial navigation 
system and a terrain comparison (TERCOM) technique which 
utilizes the radar altimeter and onboard computer. At 
predetermined points along its flight path, the missile uses 
its radar altimeter to map the profile of the terrain below. 
This "sensed profile" is compared with a preloaded digital 
map of the surrounding area. (Mapping information will be 
furnished by the Defense Mapping Agency.) Locating itself 
within the map, the missile computer determines its true 
position, velocity, and heading and makes course corrections 
if necessary. At first landfall, the missile's map may be 
Of an area measuring in the tens of miles. When it updates 
its position, it also adjusts drift rates, calibrations, and 
other guidance error contributions to make itself less and 
less depenaent upon map-correla tion updates. The radar 
altimeter then goes into "standby" until it enters the next 
position update area. Thus, as the missile proceeds toward 
its target the maps would be of smaller and smaller areas, 
since the guidance system fine-tunes out practically all 



15 



error. TERCOM is said lo resolve otjects on ihe ground as 
small as three meters wide and 30 centimeters tall from an 
altitude of several thousand meters [Ref. 3]. The TERCOM 
feature allows the ALCM to fly at lew operating altitudes 
below 100 feet [Ref. 3]. Maiimum operating altitude for the 
radar altimeter is 5000 feet above the ground. All terrain 
following is performed below this altitude. In the event of 
radar altimeter failure during terrain following, the 
missile automatically transfers to the altitude hold mode 
and flies at a preset baronetric altitude stored in the 
mission software (Figure 11, line #4), This value is 
selected to provide adequate terrain clearance for the area 
being overflown. 

This high accuracy of missile position updating results 
in extreme accuracies at the target. U.S. cruise missiles 
to date have achieved accuracies on the order of 30 feet CEP 
[Ref. 3]. This means at least 50% of the time the missile 
will land within 30 feet from the target. 

The ALCMs carried by the B-52G are prcgramm.ed initially 
with one target per missile. Anytime prior to ALCM launch, 
a new target can be entered into the missile by the 
navigator. This retargeting capability is referred to as 
"flex targeting”. Using the current integrated keyboard 
(lEB), this procedure requires approximately 1-2 minutes per 
missile to complete. Retargeting a full load of twenty 
missiles would require 20-40 minutes. 
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Accelerated production for the USAF/Boeing ALCM at 
production rates of 480 missiles per year will start in 
Fiscal 1964. This plan is predicated on the deployment of 
3,780 missiles hy 1990 on a schedule consistent with B-52G/H 
ccnversicns [Hef. 4]. 

3 . Hole of Navigator 

Responsibilities for navigation and weapons control 
in the B-52G are assigned to the navigator and radar 
navigator. The navigator determines aircraft position based 
on radar information obtained by the radar navigator. He 
compares actual position, course, etc., to preplanned 
mission course and directs the aircraft accordingly. The 
navigator is also responsible for ALCM status. If a change 
in ALCM targets is directed by appropriate authorities, he 
would be the crewmember to make these changes. 

Except during the flex targeting procedure, there are no 
other inputs the navigator rust performi with regard to the 
ALCM. He does have a constant missile status of each, and 
if one malfunctions prior to launch, it can be withheld by 
the navigator ana Jettisoned if necessary. 

4. Scenarios: Tactical S. Strategic 

The cruise missile carried onboard the 3-52G will be 
capaole of performiing non-nuclear (tactical) roles as well 
as its main role in nuclear (strategic) scenarios. 

In the tactical scenario rapid retargeting of AICMs 
could give defending forces, especially in the European 
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Theater, an unpreceaented capacity for aisrupting Soviet 
Pact supply lines, destroying support facilities, and 
attacking front-line forces during a massive thrust across 
Western Europe. A B-52G orbiting outside the battle area 
could respond to battlefield commanders by launching ALCMs 
against targets too risky for aircraft strikes, or too far 
away from artillary positions. Since tactical targets are 
very mobile, a rapid and accurate ALCt'i retargeting 
capability is essential. If a voice entry system 
significantly improved speed and accuracy then considerable 
capability would be added to the flex targeting option. 

Utilizing a nuclear warhead in a strategic role, cruise 
missiles can strengthen the air leg of the strategic triad 
of the U.S. which includes intercontinental ballistic 
missiles (ICSMs), submarine launched ballistic missiles 
(SLBMs), and strategic bombers. ALCf^s will give heavy 
ocmbers a standoff capability, ana the missile's long range 
(1550 miles) would lessen the need for bomber refueling 
[Eef . 5] . Planners could assign AL Cri-equi pped B-52Gs a 
standoff role of firing their missiles outside Russian 
airspace without actually penetrating, or firing and then 
penetrating to drop their gravity bombs, or launching ALCMs 
within Russian airspace as they penetrate. If the flex 
targeting procedure near or within these high threat areas 
was exercised, the 1-2 minutes required for retargeting each 
ALCM would increase the bomber's probability of detection by 
enemy radar. 



C. SPEICH RECOGNITION S. CRT DISPLAYS 



1. Overview 

Ever since machines have been used by man, he has 
sought ways to have more control over them. With the 
development of computers,' man continued to exercise 

mechanical control by means of keyboard interfaces or 
manually punched cards. The ability to directly communicate 
with them by voice was first envisioned by science fiction 
writers of the 1950's and 60 's. As the computer became 

faster and able to store larger amounts of infcrmaiicn, 
researchers began investigating the possibility of speech 
recognition by com.puter. 

The theory behind computer speech recognition (also 
known as voice data entry) was simple enough, at least for 
isolated words. 

The basic theory is as follows: 

1. Air pressure variations, created by speech, are first 

converted into an electrical signal by microphone. 

2. The signal's acoustic features are converted into 

computer machine language, and stored in computer 
m.emo ry . 

3. Because a word does net necessarily have the same length 

each time a speaker says it, the computer must "time 
align" its lengtn. 

4. The computer then compares the features of the "aligned" 
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word against utterances already stored in its memory. 
The computer decides whether the spoken word matches a 
word in memory. 

5. Assuming a match is found, it then performs the action 
or actions ( pre-pr cgrammed ) corresponding to that 
utterance . 

The computer thus recognizes an utterance, or word, 
within a given time frame. It also rejects any word whose 
features are too remote from those stored in its memory. 

Speech recognition can be divided into two types. The 
first is called isolated speech’’ or ’discrete" recognition. 
Each utterance is followed by a 0.1-0. 2 inter-word pause. 
In a aiscrete recognition system, the "utterance” is not 
lim.ited to just a single word. Eor example, the Threshold 
T-600 will allow utterances up to two seconds in length. 
The second type is celled ’’connected speech’’ recognition, 
similiar to normal human speech with no pauses between 
words. Utterances in connected speech units can thus oe 
made up of many individual words greater than two seconds in 
duration. 

'when one gees from computer recegnition of individual 
words (isolated speech), to full sentences as in natural 
speech (connected speech), tne problem is compounded even 
mere. In isolated speech systems, the computer can clearly 
distinguish between consecutive words. In contrast, natural 
speech wave fcims do not shew clearly where one word ends 



er. a the next begins, ana the time alignment proDlerr is far 
more difficult with connected speech than with isolated 
words. Net cnly must the computer time-align individual 
words, it must also repeat this for groups of words or whole 
sentences. Cnee an input word is recognized in connected 
speech systems, the computer must also decide which word is 
most likely to follow the input word. 

2. Value of Speech Recognition Systems 

Cochran and Riley [Ref. 7] list the following 
advantages to computer voice entry: 

1. Fast learning time 

2. Dual modes of sensory feedback 

3. Not restricted to one language 

4. Accuracy 

5. Simultaneous: Use of hands, use of eyes, data entry 

6. Automatic and multiple processing 

7. Remote entry 

fi. Simple data entry 

The learning time on a voice input device is shorter 
than on a keyboard or typewriter, and accuracy is greater 
during the learning period. Because spoken language is a 
natural part of life, data entry using voice is easy once 
the individual and machine are trained. The auditory and 
visual feedback im.meaiately reinforce correct input and 
alert the operator to an error [Ref. 7: p. 190]. 
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Because ihe machine is trained ic each operator ^s 
voice, language and pronunciation are not critical as long 

as the operator is consistent. This means that regional 
accents and even foreign languages are acceptable for use 
with the voice input device [Ref. 7: p. 191]. 

One of the primary advantages of the voice input device 
is that it frees the hanas and eyes for other basics while 
inputing data. 

Voice entry can be useful when many different or complex 
characters need to be entered in succession. The Threshold 
T-6e0 can input up to sixteen characters at once with Just 
one utterance. 

3 . Limitations of Computer Speech Recognition 

Although the advantages are numerous and appealing, 
disadvantages ana limiitation also exist. These include: 

1. Cost - Voice data entry devices vary in cost frorr $£00.00 

to over $60,000.00. As advances are made in high- 
speed integrated circuits, costs will continue to 
dec rea se . 

2. Voice input can be overheard, making security a problem 

[Ref . £j . 

3. Ambient noise interference. 

4. Training and frustration. 

5. Limited vocabulary - The user is limited to only the 

vocabulary which has been loaded into computer memory. 

6. Changes in user voice characteristics can 

retraining [Ref. 9]. 



require 



As in all technology, advantages and disadvantages 
exist. The final test is always the maricetpl ace . In both 
civilian and military appi icat ions , voice units are 
replacing more and more conventional entry devices. 
Cartography, air traffic control training, aircraft avionic 
systems, and military command and control centers are but a 
few of the present users. Industrial users are im.proving 
production line and shipping productivity with these devices 
by as much as 40% [Hef. 10]. The Navy is utilizing a voice 
unit at their ileet Ocean Surveillance Information Center, 
CINCPAC Fleet, Honolulu, Hawaii, to query their information 
data base. General Dynamics recently outfitted an F-16 
fighter aircraft with a pilot-operated voice unit for 
feasibility tests. 

4. CRT Display Techniques 

Two major c lasses of information display 
technologies exist today: the cathode-ray tube (CRT) and the 
plasma panel. The CRT has existed since the 1930's while 
plasma desplays were developed in the late 19€0's. Both use 
very different techniques to display information. 

The CRT utilizes an electron beam to excite a 
phosphorous coating which in turn emits photons. Images can 
then be created by directing the electron beam over the 
phosphorous-coated glass. 



A plasma display is simiiiar in principle to a neon 
lube. It consists of two parallel glass plates each with 
rrany parallel conductors. The plates are separated by a 0.1 
irillimeter gap filled with neon gas. A voltage between the 
intersection of two conductors will emit a glow. Many of 
these points of light can be made to form images. 

The B-52(i displays were required to display alphanumeric 
information as well as the radar presentation. This meant a 
display technique capable of fast updating, which the plasma 
display is unable to do [Ref. 11]. Thus, the type of 
display selected for use on the E-52G was the monochromatic 
CRT. Methods of highlighting information on a monochromatic 
CRT include: 

Jlashing - Turning displayed information on and off at 
approximately 3-5 Hz. 

Inverse Video - A1 phanumerics displayed as dark characters 
over a white background. 

location - Position information as in double-spacing. 
Highlighting - Achieved by overwriting with the electron gun 
thus causing the image to stand out. 

D. STATEMENT Of THE PROBLEM 

Part I of this thesis evaluates operator performance of 
the flex targeting procedure using the present integrated 
keyboard (ISE) input device and a voice input device. 
Operator speed and accuracy were used to evaluate each 
system. Would voice entry improve the operator's 
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perl'orrrance as defined by these pararneters? Each subject 
used both input devices in loading twenty AICM target sets 
per device. A "target set" is defined as the data corrprised 
of 45 characters the ALCM needs loaded in its ttetnory to fly 
to and locate the target (Figure 11). 

Part II compares the way in which this information is 
presently displayed (single-spaced) on the navigator's CRT 
with twc alternative methods of presentation. These two 
alternatives are double-spacing and inverse-video. 
Characters displayed in inverse-video are shown as darK 
figures against a white bacifground. Normally, characters 
are displayed as white characters over a blacJt background. 
Curing the inverse-video portion of Part II, as a line is 
updated, that line is "inverse-videoed" when reinserted into 
the target set. It was hoped that this would help the 
operator in scanning the target set in search for values to 
oe changed out. 

A capability of exercising the flex targeting option 
using voice input might s ignif icantly reduce bcirber exposure 
in enemy airspace, while giving military and civilian 
leaders miore time for retargeting decisions based on 
reconnaissance, changing military and pciitical factors, 
etc. The method of displaying the flex targeting data on 
the CRT could also have a similar effect. 
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I. HYPOTHESES 

The foilcwing hypothesis were tested: 

1. Hypothesis Regarding TIME 

H : There is no difference in Time to 

o 

enter complete target sets among 
the two entry modes. 

Hj : Complete target sets will be entered 

faster using the voice entry mode. 

H : There is no difference in Time to 

o 

verify and correct target sets among 
the three types of display formats. 

Hj : Target sets wiii be verified and corrected 

fastest using the inverse-video format. 

2. Hypothesis Regarding ACCURACY 

: There is no diiference in the Accuracy 

of target sets among the two entry 
modes . 

H^ : Target sets wiii be entered more 

accurately using the voice entry mode. 

: There is no difference in Accuracy in 

verifying and correcting target sets 
among the three types of display formats. 

; Target sets will be most accurately 

verified and corrected using the inverse- 
video format. 
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II. DESCRIPTION OP THE EXPERIMENT 



A. OBJECTIVES AND CONSTRAINTS 

The purpose of ihis experirrent was twofold. First, to 
determine whether computer voice technology was better than 
keyboard entry for loaning tne ALCM flex targeting data. 
The performance of both entry methods, computer voice and 
the integrated keyboard (IKB), would be measured by subject 
input speed, accuracy, and time versus accuracy. Second, to 
determine which of three methods of data presentation on the 
CRT would be best suited for the flex targeting procedure. 
The performance of each display presentation would be 
determined by subject input speed, accuracy, and time versus 
accuracy in changing displayed flex targeting data. 

An effort was made to reconstruct the B-h2G navigator's 
workstation in carrying out these objectives. Only ALCM 
related controls and displays were incorporated into the 
mockup (see Figure 2). 

B. EQUIPMENT 

1. Navigator Position 

For the purpose of this thesis we will assume 
through some communications means the B-52G crew can 
successfully receive new ALCM targeting information from 
higher authorities. Also assumed is that the information 
can be readily decoded and handed to the navigator in paper 



fcrin which will then oe manually entered intc the 
appropriate ALCr^. The Keyboard the navigator would use is 
unique to the B-52G . It interfaces with the Offensive 
Avionics System (OAS) wnich controls both navigation and 
weapons. Both navigator and radar navigator have a keyboard 
as well as two cathode-ray tube (CRT) displays for each of 
their posticns (see Figures 3,4). In actuality, either 
operator can change ALCT target information. But in most 
cases,' and for the purpose of this thesis, the navigator 
will carry out the procedure (see Table I). 

In simulating the operation of this crew position at the 
Human Factors Laboratory, an APPLE II "plus" 64K 
minicomputer and a CONRAC 7x5 inch CRT display were 
positioned in front of ana aoove the suoject's seat 
position. A keyboard was built to look and operate like the 
integrated Keyboard (ISB) founa currently in the B-52G. 

The navigator's position dimensions and equipment 
location for this experiment were obtained from the OAS- 
ccnfigured T-ie navigation simulator located at Wright- 
Patterson Air Force Base. 

2. Integrated Keyboard (IKB) 

In order to measure target set entry times by 
keyboard, a working model of the IKB used in the B-52G was 
built. Its dimensions ani pertinent keys were duplicated 
exactly (see Figure 5,6). The IKB was connected via a Lear 
Siegler Inc. Arr^-3A terminal to an APPLE II minicomputer. 
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Figure 2. Diagram of Equipment Setup 
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Figure 3. Radar Navi gator/Navi gator Positions, B-52G 
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Figure 4. IKB at Radar Navigator/Navigator Positions 




The AEM-3A was needea oecause the APPLE II design did not 
allow direct connection of the IKB to the APPLE II 's 
Keyboard plug directly. 

3 . Apple II Corrputer 

An APPLE II "plus" 64K RAM (Handom Access Memory) 
irinicorrputer was used to control all video displays on the 
GONRAC CRT (see iigure 7). As each subject entered target 
set data, the information was stored in main memory to be 
printed cut after the session using a MICRCLINE Micron E0 
printer. These printouts were later used to check for input 
errors . 

4. Voice Recognition System: T600 

A Tbresnoid Technology Inc. T-600 (hereafter 
referred to as the T600) was used as the voice recognition 
input device (see Figure S). It is a commercially available 
device capable of recognizing up to 256 spoken words or 
phrases. These phrases or utterances as they are called 
must be limited to 0. 1-2.0 seconds in length [Ref. 12]. 

A short pause of at least 0.1 second is required between 
each utterance. Thus the T600 is referred to as an isolated 
or discrete speech voice recognition unit. The T600 voice 
recognition system consists of a main terminal processor 
unit containing a speech preprocessor and microcomputer. 
The remaining components, the tape cartridge unit, the 
microphone preamplifier and display (present but not used 
during experiment) are connected separately. 
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Figure 5. Actual Integrated Keyboard (IKB) 
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Figure 6. Working Model of Integrated Keyboard (IKB) 











Figure 7. APPLE II Computer and CONRAC CRT 






The microphcne used was a noise cancelling SHURS SM-10. The 
T600 was connected to the APPLE II via an APPLE serial 
interface with RS-232 standard input /output . 

When the T600 receives an utterance spoken by a subject, 
the voice unit will react in one of two ways. The utterance 
will be compared with those patterns in memory, and, if a 
matcn is found, the corresponding output string will be 
transmitted. The alternative is that no match will be found 
between the utterance received by the T600 and that 
programmed in its memory. If the latter occurs, an audible 
"beep" is sounded with no output string transmitted. This 
is referred tc as a nonreccgnition . It can result from 
either mispronunciation of the utterance, poor initial 
training of the word, background ncise being interpreted by 
the T600 as an utterance, or lack of T600 reliability. 

C. SUBJECT SELECTION ANE TRAUaMG 

1. Subject Selection 

Subjects used for this experiment were students and 
faculty of the Naval Postgraduate School. Four were female 
and sixteen male. All except five had nc previous 
experience with voice entry and none had used a E-52G IKB 
prior tc this experiment. Seventeen were active duty U.S. 
military officers and three were civilians. 
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Figure 8. T600 Voice Recognition Equipment 






2. T6043 VoceDblary Training 



Before ihe T600 couid be used as an input device in 
place of the IKE, voice patterns for ail input commands had 
to be recorded into the Te00's nemory. This is referred to 
as "training". Subjects ^ould repeat each of the twenty 
vocaDulary words (see Appendix A) ten times into the 
microphone. The microcomputer within the T600 averages the 
ten utterances into one digital pattern of that word. This 
training was done for each of the twenty words. Each 
vocaDulary word had a corresponding output string. Thus, if 
the T600 recognizes an utterance as "zero", it would output 
a "0", and so on. The output string in the T600 can be up 
to sixteen characters in length. 

After the twenty words were trained, each was repeated 
three times to confirm the T600 was able to identify them. 
If a mi srecogni ti on or a nonrecognition ("beep" sound) 
occurrea 2 out of 3 times or greater for a given word, it 
was retrained. 

3. Integrated Keyboard Training 

All subjects had never seen an IKB before 
participating in this experiment. As stated in the "Script 
And Instructions To Subjects" (see Appendix E), the 
operation of the IKB was shown to each subject and each was 
allowed unlimited practice using a sample computer program 
until they felt comfortable with the IKB. 
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D. DEPENDENT VAHIABLE^s 

The following variables were calculated for each group 
of 20 target sets; 



% Input Accuracy Typing (lAT) 



% Output Accuracy Typing (CAT) 



% Input Accuracy Voice ( lAV ) 



'% Output Accuracy Voice (CAV) 



NCE 




NCE + 


NICE 


■+ nme 






NCC 






NCC + 


NIC 


+ NMC 






NCE 






NCE + 


NICE 


+ MfiE 






NCC 






NCC 4 


NIC 


+ MMC 



X 100 



X 100 



X 100 



X 100 



Legend : 



NCC 


: Number 


of 


NMC 


: Number 


cf 


NIC 


: Number 


of 


NCE 


: Nurrber 


of 


NME 


; Number 


cf 


NICE 


: Number 


of 



Correct Characters = 4E/target set 
Missing Characters (sarre as NME) 
Incorrect Characters 
Correct Entries = 68 , Tax/target set 
Missing Entries (sarne as NMC ) 
Incorrect Entries 



Character - Displayed entries \hich are ultirrateiy leaded 
into the ALCM. 

Entry - An input which nay or nay not be ultirrateiy loaded 
into the ALCM. 
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NCI 

% Correci Entries = x li'C 

NME + TNS 

Legend: NCI : Nuirber of Correct Entries = 58 rrax/target set 

NME : Number c. Missing Entries (same as NMC) 

TNE : Total Number of Entries = 

NC2 + NICE + NFUTCE 

Character - Lispiayed entries which are ultimately loaded 
into the ALCM. 

Entry - An input which iray or may not be ultimately leaded 
into the ALCM. 

E. EXPERIMENTAL DESIGN AMD PROCEDURE 

Each subject first performed Part I, the "Target Loading 
Task' , in Vkhich he first entered 2? ALCM target sets 
beginning with either the Integrated Keyboard (IKB) or the 
T6CC voice input device (see Appendix C for subject order). 
Part I of this thesis was a two-way design as illustrated in 
Figure 9. Subject order with the two conditions was 
determined using an ABBA ordering method. This was repeated 
using the second entry method with the same target sets. 
Performance of each subject was recorded using data sheets 
shown in Appendix D. The twenty target sets used in Part T 
are contained in Appendix E. 

Part II was a two-way design as illustrated in liar re 
10. This part of the thesis was called the "Target 
Information Verification Tash". Here the STibject was 
required to examine each of eighteen target sets, ordered in 
three groups of six , which had ceen preloaded by the author 
(see Appendix E ) . 
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VOICE IKB 



1 

2 

•T, 

S 4 

5 

U 6 

7 

B 6 

y 

J 10 

11 

S 12 

13 

C 14 

13 

T le 

17 

S IS 

19 

20 



TARGET LOADING 
TASK 

CONCEPTUAL DESIGN fPART I) 



Eigure 9 



He then compared each tc a list in which varices characters 
had been changed. Changes varied from 0 to 9 characters per 
set. Some target sets required no corrections, while ethers 
required many (see Appendix G). The subject had to locate 
each value in the target set tc oe changed , and mahe the 
required changes (see Figure 11). Only the Integrated 
Keyboard (IKB) was used as the entry device for Fart II. 
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SINGLE-SPACE DOUBLE-SPACE 



INVERSE-V IDEO 



1 

2 

3 

S 4 

a 

U 6 

7 

B S 

9 

J 10 

11 

E 12 

13 

C 14 

15 

T 16 

17 

S 18 

19 

20 



TARGET INFORMATION VERIFICATION TASK 
CONCEPTUAL DESIGN (PART II) 



Figure 10 



Each of the three groups of six target sets required a total 
of 26 randomly distributed changes per group, group. The 
first set Of six target sets was displayed in a single- 
spaced format as is presently dene in the B-52G (Fig. 11). 
The second set of six was displayed in noutle-spaced form. 
The third set of six was displayed single-spaced, but as a 
line was modified, that line then became displayed in 
inverse-video form. Characters displayed in inverse-video 
are shown as dar.-t figures against a white background. For 
details of the experimental procedure, see Appendix B. 
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1 FLEX TARGETING 
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E000000000 < target longitude 
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00000 \flightpath information 
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TARGET SET FCRMAT CURRENTLY USEE FOR 
(Adapted from Reference 



FLEX TARGETING 
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FIGURE 11 
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ALCK LOCATION AND IDENTIJI CATION CODES 
Figiire 12 
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TAdLS I 



RETARGETING PROCEDURE 



ACTION 



RESPONSE 



1. Desired ALCM is selected 
by navigator. 



2. Line #1 is selected to be 
changed . 



3. New data is entered using 
keyboard for line ffi . 



4. New line ftl is completed; 
"enter" button is pressed. 

t. Line is selected to be 
changed . 



1. CRT in front of nav- 
igator displays target 
information as shown 
in Figure 11. 

2. Line #1 is repeated at 
bottom of CRT ready to 
be changed as shewn in 
Figure 11. 

3. New line #1 appears at 
bottom of CRT as it is 
typed, overwriting the 
original line #1. 

4. Old line Pi is replaced 
by new line #1. 

b. Line #2 is repeated at 
bottom of CRT ready to 
be changed. 



This procedure is 
changed out. Afte 
the ALCNl is ready 



continued until all five lines have 
r the last line ( #5 ) has been ente 
for launch against its new target. 



been 
red , 
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In Parts I and II, subjects called up each tar,get set as 
is done in the B-52G usin^ a let ter-numcer ccr^b inat icn . The 
sii ALCMs stored under the left aircraft pylon are referred 
to as A1 through A6 . The eight stored in the bomc bay are 
referred to as El through B6. The six ALCMs stored under the 
right aircraft pylon are referred to as Cl through C6. 
Figure 12 shows pictorally the identification and position 
of each ALCM. 
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III. RESULTS 



A. INTRODUCTION 

Results for Fan I (Targei Loading Task) and Part II 
(Target Inforrration Verification Task) will be disoossed 
separately. For each, the resoits are suDdivided into Tiire, 
Inpot and Output Accuracies, and Tirre versus Accuracy. Raw 
data analyzed in this section is contained in Appendixes H 
a nd I . 

B. RESULTS FOR PART I 

1 . Time 

Figure 13 is a plot showing the time required for 
each subject to load ail twenty target sets. Keyboard entry 
was faster than the voice entry technique for fifteen of the 
nineteen subjects. Ho difference was noted in the time to 

complete using either technique for one subject, while voice 
entry was faster for tnree subjects. The five subjects at 
the far right of the graph had previous experience with 
voice entry. Analysis of Figure 13 indicates no marked 
difference among those with prior voice entry experience. 
I^ean and standard deviation for the voice data are Z7.56 and 
3.42 respectively. Mean ana standard deviation for the IK? 
data are 24.64 and 5.15 respectively. 
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Time 

(Minutes ) 



40 - 



V = Time (nearest miin.) for Voice 

K = Time (nearest min.) for IKB 

B = Voice Time = IXE Time 
^ = Previous experience with Voice Entry 

K 

i> 

1 1 
1 1 
' I 
I \ 

I \ 

• I 



I 




K 



10 
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~ ( I 



1 2 




I I 

I I 



I I I 



e 7 e 9 10 12 14 16 18 20 11 12 

^ >? 



16 17 19 

jy 5|5 ^ 



SUBJECTS 



Figure 13. Time by Subject 
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TABLE II 



ANALYSIS CF 


VARIANCE: 


SUBJECT 


BY TIME 


- PART I 




SOURCE 


SS 


df 


MS 


F 


P 


Between Subjects 


412.43 


19 


21.71 


1.32 


n s 


Between Methods 


85.24 


1 


85.24 


5. IB 


<.05 


Error 


312.84 


19 


16 .47 






Tcta 1 


810,52 


39 








The Integrated 


Keyboard 


1 npu t 


method 


proved 


to be 



s i^nificaniiy quicker than the voice method as shcv;n in 
Table II (P <.Z£ ) . 

2. Input Accuracy 

Figure 14 shows Subject by Percent Input Accuracy. 
The IK3 percent input accuracy was higher for 74 percent of 
the subjects. Voice was better for 26 percent. This v/as 
confirmed using an Analysis of Variance shown in Table III. 
lEB input accuracy was significantly better (P < .01) than 
voice entry. (In order to meet requirements regarding the 
distributions of the data, an arc-sine transformaticn was 
applied to the percent input accuracies prior to performing 
the Analysis of Variance.) 



TABLI III 



ANALYSIS C5 VARIANCE: SUBJECT BY INPUT ACCURACY - PART I 



SOURCE 


SS 


df 


MS 


V 


p 


Between Subjects 


0.5759 


19 


0.0303 


1 .31 




Between ^'ethods 


0 .i:536 


1 


0.2538 


10.99 


<.01 


Error 


0.4383 


19 


0.0231 






Total 


1 .2680 


39 








3. Output Accuracy 










Figure 15 


shows : 


Subject 


versus 


Percent 


Output 


Accuracy. Analysis 


Of Variance 


in Table 


IV confirmed no 



Significant difference between voice and IKB percent output 
accuracies existed. (In order to treet requiren^ents 
regarding the distributions cf the data, an arc-sine 
t ransf orrr.a ti on was applied to tde percent output accuracies 
prior to perfcrmins the Analysis cf Variance.) 



t2 



Percent 

Input 

Accuracy 



V = Input Accuracy Vcice 
K = Input Accuracy Keyboara 
B = Voice In.Acc. = Keyboard In.Acc. 
« = Previous Experience With Vcice 
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iigure 14. Input Accuracy by Suoject 
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TABLE IV 



ANALYSIS Oi VARIANCE: SUBJECT BY OUTPUT ACCURACY - PART I 



SOURCE 


SS 


df 


MS 


F 


P 


Between Subjects 


0.7946 


19 


0.0416 


<1 


ns 


Between Methods 


0.0214 


1 


0.0214 


<1 


ns 


Error 


1 .05yb 


19 


0.0556 






Total 


1 .6765 


39 








4. Time Versus 


Accuracy 










Figures 16 


through 


19 


show Input 


and 


Output 



Accuracies plotted against Time for Doth voice and IKB entry 
methods. Figure 16 shows no apparent tradeoff "between 
Percent Input Accuracy and Time for voice entry. However, 
Figure 17 through 19 show pronounced increases in accuracies 
as time to complete the tas^ increased. 



Percen i 
Output 
Accuracy 



V = Output Accuracy Voice 

K = Output Accuracy Keyboard 

B = Voice Out.Acc. = Keyboard Out.Acc. 
ssf = Previous Experience With Voice 
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Figure 15. Output Accuracy by Subject 
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Figure 16. Percent Input Accuracy by Time 

For Voice 
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Pigure 17. Percent Input Accuracy by Time 

For IKB 
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Figure 18. Percent Output Accuracy by Time 

For Voice 
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C. RESULTS FOR PART II 
1 . Time 

Figure 20 shows average times for each of the three 
display formats tested. Analysis of Variance between the 
three display formats shown in Table V indicated no 
significant differences. However, a significant difference 
between subjects (P <'. 01 ) was detected. 



TABLE V 

ANALYSIS OF VARIANCE: TirE 
BY DISPLAY FORmiATS - PART II 



SOURCE 


SS 


df 


^^S 


V 


p 


Between Subjects 


37.52 


19 


1.97 


cu 


<. 


Between l^ethods 


1 .15 


2 


0.57 


1 .30 


ns 


Error 


16.76 


36 


0.44 






Total 


. 4 ^ 


59 









ts 



Average 

Tir;e 

(minutes ) 



7 



I 

I 



I 

I 

I 



1 

I 



I 

I 

I 

I 

I 

I 



6 
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I 
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Figure 20. I^ean Time And Standard Deviation to 
Complete Update Using Each Display Format 
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2. Input Accuracy 

Figure 21 shows I^ean Input Accuracy plotted 
against each Display Icrmat. Nc significant difference was 
found between display forrrats as shown in the Analysis of 
Variance in Table VI. iln order to rreet requirements 
regarding the distributions of the data, an arc-sine 
transformation was applied to the percent input accuracies 
prior to performing the Analysis of Variance.) 



TABLE VI 

ANALYSIS OF VAEIANCI: SUBJECT BY 
INPUT ACCURACY - FART II 



SOURCE 


SS 


df 


^'S 


y 


P 


Between Subjects 


0.9408 


19 


0.0495 


1.10 


n s 


Between r^ethods 


0 .0233 


2 


0.0116 


<1 


n s 


Error 


1.7105 


38 


0.0450 






Tcta 1 


2 .6746 


59 
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Figure 21. ^’ean Input Accuracy And Standcrd Deviation 

For Each Display Format 
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3. Oulpul Accuracy 



Figure 12 shows Mean Output Accuracy plotted 
against each Display Format. No significant differences 
were computed as shewn in the Analysis of Variance in Table 
VII. (In oner to meet requirements regarding the 
distributions of the data, an arc-sine transf orr:a tion was 
applied to the percent output accuracies prior to performing 
the Analysis of Variance.) 



TABLE VII 

ANALYSIS OF VARIANCE; SUBJECT BY 
OUTPUT ACCURACY - PART II 



SOURCE 


SS 


Between Subjects 


2.610 


Between Methods 


0.096 


Error 


3.189 



df 


MS 


F 


? 


19 


0.136 


1 .64 


n 5 


2 


0 . 048 


<1 


n 5 


36 


0.064 






c9 









Total 



t .S9h 



Mean 

Ouipiu 

Accuracy 

100 - 



90 - 



80 - 

I I I 

I I I 

Single-Space Double-Space Inverse-Video 

Display Format 



Figure 22 . Mean Output Accuracy And Standard Deviation 

For Each Display Format 



4 . Time Versus Accuracy 

Analysis of Variance for subject times and input and 
output accuracies shewed nc significant differences. 
However, plots of Percent Input Accuracy versus Time for the 
three display formats indicate the double-space format 
resulted in the best percent input accuracy over time. 
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Percen i 
Input 
Accuracy 
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7 




T lire (min . ) 

figure 23. Percent Input Accuracy Dy Time 
(S ingle-Spe ce ) 



Figures 23 and 25 show data scattered over wider ranges as 
compered with iigure 24 wnich shows good clustering above 
the 95 percent level. 
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Percent 

Input 

Accuracy 



100 - 



90 - 



X X 



X I 



X 

XXX 



XX 

X 




T ime (min . ] 

ligure i;4: . Percent Input Accuracy by Time 
(Double-Space ) 
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Percen i 
Input 
Accuracy 




T ime (min . ) 

Figure 25. Percent Input Accuracy ty Time 
( Inverse-Video ) 



AD examination of the Percent Output Accuracy hy 
plots showed no significant grouping of the data 1 
three display formats. 
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IV. CONCLUSIONS AND RICON’N’ZNDATI CNS 



A. GENERAL 

The purpose of this thesis has been twofold. Part I 
investigated the use of a discrete voice entry system in 
loading Air Launch Cruise N'issile (ALCNi) target information. 
A direct comparison was made between voice entry and the 
integrated keyboard (IKE) presently operational. Time to 
lead, input and output accuracies, and time versus accuracy 
measurements were recorded for each of the twenty subjects. 

Part II investigated three means of displaying the ALCf^; 
target information on a CRT. Information was updated using 
single-spaced, double-spaced, and inverse-video formats. 
Only the IKE was used in Part II. Time to update, input an 
output accuracies and time versus accuracy measurements were 
recorded for each subject. 

B. CONCLUSIONS 

1 . Part I 

It had been hypothesized that target sets would be 
entered faster using the voice entry method. However, the 
IKE was significantly faster (P < .05) than the voice 
method. It was suspected that this may have teen due in 
part to first time use of the voice entry device by fifteen 
out of twenty subjects. Due to experimental time 
constraints, subjects had at most 15-20 minutes to practice 
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with voice entry prior to running the experiment. However, 
analysis of Figure 13 shows that only two out of the five 

subjects with prior voice entry experience accomplished data 
entry quicicer using voice. Thus, prior exposure to voice 
did not improve subject entry times. It should be noted 
that despite slower input speeds using voice entry, 60 
percent of the subjects preferrea voice entry use over the 
IKB. 

It should be noted that a discrete voice unit was used 
fcr this experiment. However, a "connected speech" 
recognition unit would have been more appropriate for this 
tasK, and probably would have shown faster input times. A 
connected speech system is able to receive multiple inputs 
at cnce, ie., "1-4-3-Z-5" , with no pause between utterances. 
This more natural speech would be more comparable with 
keyboard entry than the discrete voice entry. Unfortunately 
such a system was not available. 

It was hypothesized that target sets would be entered 
more accurately using the voice entry method. The IKB was 
significantly higher in input accuracy (P < .21) than voice 
entry. Thus fewer corrections were made to data on the 
screen before committing it to the weapon using the IKB 
entry technique rather than voice entry. 

Another factor which effected input accuracy was the 
training of the voice unit by the subject. S^ch utterance 
was repeated three timies in order to detect poor training. 
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If the voice unit had problems recognizing an utterance 
either after training or during practice, that word was 
retrained. In many instances it was not noticed until well 
into the experiment that certain words had either teen 
poorly trained or were being pronounced differently by the 
subject. Changes in pronunciation may also be attributed to 
the stress imposed by the experiment which was not present 
during the vocabulary training session. Regardless of the 
explaination, subjects made less errors using the IKB method 
of entry. 

No significant difference in the output accuracy existed 
between input devices. This indicates the data was checked 
equally well by each subject prior to entering the data and 
moving on to the next weapon, irrespective of entry 
technique . 

No apparent tradeoff was noted between Percent Input 
Accuracy and Time for voice entry (see Figure 16). However, 
pronounced increases in accuracy were noted for Percent 
Input Accuracy by Time using the IKB (see Figures 17). 

Possible fatigue was suspected during the voice entry 
portion in Part I. Subsequent analysis of all 
misrecognitions and nonrecognitions over the twenty target 



sets shewed 


an increase 


in 


average 


errors as the 


the 


experiment 


progressed , 


but 


this 


increase was 


not 



statistically significant (see Table XIII). 
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2 . Part II 



It was hypothesized that target sets would be 
verified and corrected quickest and most accurately using 
the inverse-video format. Analysis showed no significant 
differences in time, input or output accuracies, and time 
versus accuracy between the three display formats tested. 
This was rather suprising. It was originally believed the 
single-space format would require much mere time and induce 
more errors than the other two methods. There were 
differences in subject preference among the three display 
formats. The double-space format was preferred by 65 
percent, as compared with 20 percent for the inverse-video 
and 15 percent for the single-space. 

C. RECOtIMENrATIONS 

Based on the data in Part I it can be concluded that 
while voice entry is definitely preferred, the IKE is 
superior in entry speed and input accuracy. Due to limited 
resources, this thesis had cnly a discrete voice entry 
device to measure against an IKB. It is the author's 
opinion that a conected voice unit would have shown much 
greater input speeds than the discrete unit used here. 
Thus, voice applications in areas requiring quick leading of 
single characters should Iook toward the continuous voice 
systems for improvenent over conventional keyboard entry 
devices . 
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While there was no significant difference airong the 
three display formats, it is suggested that the double-space 
display format be used. Use of this format would incur no 
additional cost and would satisfy user preference. 

It might be desirable to compare the effectiveness of 
the three display formats under subject posed and 
experimenter posed conditions. Thus, the effect of stress 
could be simulated. 

A brief examination of nonrecognitions in Table XIV 
indicated that the terms 0, E, 4, end 5 were more often not 
recognized than the other numerical terms. A X' vvas 
performed on the frequencies observed for the 0 through y 
entries and a % value of 137.53 >ias obtained (10 df, P < 
.001). The 0 through 9 values had been drawn from’ a table 
of random numbers, thus each had an equal probability of 
being misreccgnized . The data suggests that the entries 
0, 2, 4, and 5 are over-represented while the entries 9 and 
3 are under-represented. 
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APPENEIX A 



T600 VOCABULARY LIST 



T600 

Location 

Register 



000 

001 

002 

003 

004 

005 

006 

007 

008 
00y 
010 
011 
012 

013 

014 

015 

016 

017 

018 
019 



T600 

Output 



zero 

one 

two 

three 

four 

five 

six 

seven 

eight 

nine 

control 

irodify 

er. ter 

yes 

no 

alfa 
bravo 
Chari ie 
left 
right 
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APPINEIX B 



SCRIPT & INSTRUCTIONS TO SUBJECTS 

1) The CRT and ihe integrated Keyboard (IKB) you see 
here are similiar to those found at the navigator's position 
in the B-52G . I will be measuring your ability to load 
target information in actual ALCM formats using Keyboard and 
voice entry. The eiperiment is divided into two parts. 
Part I will require you to load 20 ALCM target sets using 
both the IKB and voice entry. Part II will require you to 
call up each of sii ALCM target sets I have preloaded, and 
mate corrections to them if necessary with new values you 
will have in front of you. This will be done three times, 
each with a different CRT display format. 

2) Show photos (Figures 3,4) of navigator's position in 
B-52G. Show actual IKE (Figure 5} and the working model 
used in experiment (Figure 6). 

3) If the voice unit is used first, train the 20 
vocabulary words at this time. Explain the theory of voice 
entry. After words have been trained, have subject repeat 
each three times, confirming the voice unit can understand 
at least two out of the three utterances. For each word 
failing the above test, have subject retrain that word. 

4) Show subject typical ALCM target sets. Run practice 
computer program. Show subject how to call up, enter, 
modify, etc., target sets. 
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You have as rruch tirre as you feel is necessary lo 
practice. When you feel corrfortabie with the procedure, we 
will proceed with Part I of the experiment. 

(Answer any questions and assist if necessary.) 

5) You will be given 2<d ALCM target sets printed on 3 
sheets of paper. When I say, "reaay, begin", enter the sets 
as fast as possible while maintaining accurate inputs. If 
you make a mistake, be sure to correct it. 

Any questions? Ready, begin. 

6) Repeat above paragraphs (4) and (5) using other 
entry method, after subject completes a ten minute break. 

7) We will now begin Part II of the experiment. I have 
preloaded 18 ALCr^ target sets in three groups of six. You 
will be given each set of these six target sets separately 
on a sheet of paper with seme of the values changed. You 
will be required to display each target set on the CRT, 
compare it to the corresponding target set on the paper, and 
make the necessary corrections to the target set on the CRT. 
Some target sets will require no corrections, while others 
will require many. Each group of six target sets will be 
displayed on the CRT in one of three ways; single- spaced, 
double-spaced, or inverse-video. 

Show subject example of ALCM target sets with changed 
values on a sheet of paper. Run practice computer program. 
Allow subject to practice until he is comfortable with the 
procedure . 
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You have as rruch litre as you feel is necessary to 
practice. When ycu feel comfortable with the procedure, we 
will proceed with Part II of the experiment. 

(Answer any questions and assist if necessary.) 

8) Repeat item #7 if subject fails to understand Part 
II of the experiment. 

If you maHe a mistake, be sure to correct it. 

Any questions? Ready, begin. 

y) Repeat above paragraphs (7) and (£) using other 
entry method. 
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APPENDIX C 



EXPERIMENTAL ORDER FOR SUBJECTS 



SUBJECTS 1 ,3 ,£ ,7 ,y ,11 ,13 ,15 ,17 ,iy performed Pari II of the 
experiment in the following order: 

Target Leading Task - Vo i ce , Key board 

SUBJECTS 2 , 4 ,6 ,8 , 10 , 12 , 14 ,16 , Ic , 20 performed Part II of the 
experiment in the following order: 

Target Loading Task - Key board , Voice 

SUBJECTS 1,2,3,5,8,7,9,11,13 performed Part II of the 
experiment in the following order: 

Target Information Verification Task - 
Single-Spaced, Double-Spaced, Inverse-Video 

SUBJECTS 15,17,19,4,6 performed Part II of the experiment in 

the following order: 



Target Information Verification Task - 
Double-Spaced, Inverse-Video, Single-Spaced 

SUBJECTS 10,12,14,16,18,20 performed Part II of the 

experiment in the following order: 



Target Information Verification Task - 
Inverse-Videc , Single-Spaced, Double-Spaced 

Note: All twenty subjects performed first 

Part I, "Target Loading Task". This 
was followed by Part II, "Target 
Information Verification Task". 
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APPENDIX D 



NAN^E; 

DATE: 



SUBJECT DATA SHEETS 
TARGET LOADING TASK DATA SHEET 

RANK: 

SERVICE: 



ACCURACY 

lAT 



OAT 



lAV 



OAV 



VOICE or KEYBOARD 
Nr^E = NNC 
NCE 



TNE 



% Correct Entries 



77 



I 



■ 'i® 

< n^v%in. 







m 




VliJ 



r^oi 




')•> 










TARGET LOADING TASK DATA SHEET 



CIRCLE ONE; 



VOICE 



KEYBOARD 



WEA.# I NIC 

[ 



A1 [ 



NN!C ] TIKE 
NME ] min. 
] 

] 



NICE 



NEUTCE 

line# #entries 



A2 [ 



[- 

[ 

A3 [ 
[- 



A4 



[ 



[- 

[ 

A6 [ 
[. 



[ 

B1 [ 
[. 



[ 

B2 [ 

[- 

[ 

B3 r 



B4 



B5 



B6 



L 

B7 [ 

[. 

[ 

E8 [ 
[. 
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TARGET LOADING TASK DATA SHEET (cont.) 



WEA.# [ NIC 

[ 

======[==== 

[ 

Cl r 

[ 

[ 

C2 f 

1 

[ 

C3 [ 

[ 

[ 

C4 [ 

I 

[ 

C5 [ 

[ 

[ 

C6 f 



CIRCLE ONE: 



NMC ] Tir.E 

NMS ] min. 

====] ===== 

] 

] 

] 

3 

3 

] 

3 

3 

] 

3 

3 

] 

3 

3 

] 

3 

3 



VOICE 



NICE 



N 



M 

N 



N 



M 

N 



M 

M 



M 

N 



KEYEOARD 

NEUTCE 

line# #eniries 
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TARGET INFORMATION VERIFICATION DATA SHEET 



CIRCLE ONE: SINGLE-SPACED DOUBLE-SPACED INVERSE-VIDEO 

ACCURACY 

lAT 

OAT 



KEYBOARD 
NME = NMC 
NCE 
TNE 

% Correct Entries: 
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TARGET INFORMATION VERIFICATION DATA SHEET 



WEA.# [ # Incorrect Char. I NIC 
[ to be changed out! ! 


TIME j NICE j NEUTCE ! 

min. 1 j j 


1 1 J 

[ ! ] 

A1 [ 6 1 ] 


1 1 1 

1 1 1 

1 1 1 

1 1 1 

1 . . I ■ . r . 


1 1 ] 

A2 [ 3 ! : 

. . r - . - 1 


1 \ 

1 1 1 

1 1 1 

1 1 1 

1 1 1 

1 1 


L 1 ^ 

[ ! ] 

A3 [ 8 1 ] 

r • 1 


1 1 

1 1 1 

1 1 1 

1 1 1 

1 1 i 

1 1 


[ ! : 

A4 [ 3 ! ] 

r ' 


1 1 

1 i 1 

1 1 1 

1 1 1 

1 1 1 

1 1 


1 ! ] 

A5 [ 6 1 ] 

r . 1 


1 1 

1 1 1 

1 i 1 

1 1 1 

1 1 1 

.1 .1 


1 J 

[ ! ] 

A6 [ 0 1 ] 

r 11 


1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 


L . - , — - J 

i I ] 

B1 [ 3 I ] 

r _ I 1 


1 1 

1 i 1 

1 1 1 

1 1 1 

1 1 1 

1 1 ...... 


L — \ J 

i I ] 

B2 [ 4 ! ] 

r. . . . . 1 . 1 


1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 


1^^. J _j 

i 1 ] 

B3 [ 9 I ] 

r _ 1 " 


1 1 

1 1 1 

1 1 1 
1 1 1 

. 1 . .1 


1 1 — — J 

i 1 ] 

B4 [ 4 ! ] 


1 1 

1 1 1 

1 1 1 

1 1 1 

1 1 1 

1 t 


L 1 J 

l ! ] 

B5 [ 3 ! ] 

r ^ ^ 1 


1 1 

1 1 1 

1 1 I 

1 1 i 

1 1 1 

1 , . . 1 


[ ! ] 

E6 [ 3 I ] 

r - - - I , - 1 


1 1 

1 1 t 

1 1 1 

1 1 1 

1 1 1 

1 1 


.. _ ^ _ J 

l ! ] 

B7 [ 9 1 ] 


1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 


1 ! j 

B8 [ 5 ! ; 


1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 1 
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TARGET INFORMATION VERIFICATION DATA SHEET (cont.) 



WEA.# [ # Incorrect Char.l NIC ] 
[ to be changed out! ! 


TIME I NICE 1 NEUTCE ! 

min.' 1 I 


[ ! : 
Cl [ 0 ! ] 


1 1 1 
1 1 1 
1 1 1 
1 1 1 
1 1 


L 1 J 

[ 1 ] 

C2 [ 6 ! ] 


1 ^ ^ 

1 1 1 

1 1 1 

1 1 1 

1 1 1 

1 1 


_ — - 1 “J 

[ ! J 

C3 f 1 1 ] 


1 1 

1 i 1 

1 1 1 

1 1 1 

1 1 1 

1 1 


[ ! ] 
C4 [ 5 ! ] 


1 1 

1 t 1 

1 1 1 

1 1 1 

1 1 1 
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APPENDIX E 



TAHGET LOADING TASK INPUT DATA LIST 



WEAPON A1 : 



WEAPON A 2 : 



WEAPON A3 : 



WEAPON A4 ; 



WEAPON A5 : 



WEAPON A6 : 



1 N31864725 

2 E467214065 

3 1965430873 

4 97031687439 

5 61498 



1 N 19857435 

2 E973687525 

3 1210934753 

4 53272361071 

5 40912 



1 N56872130 

2 E120957264 

3 1295725482 

4 07362756364 

5 28158 



1 N62659374 

2 S59832618fa 

3 3871946572 

4 26386610864 

5 18452 



1 N 10725497 

2 E728552547 

3 1850724572 

4 75189473575 

5 26836 



1 N 16500364 

2 S860375724 

3 0734712641 

4 16406437553 

5 65838 
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WEAPON B1 ; 



WEAPON B2 : 



WEAPON B3 : 



WEAPON B4 : 



WEAPON B5 : 



WEAPON £6 : 



WEAPON B7 : 



1 N 17896354 

2 E194653853 

3 5481937906 

4 64868351041 

5 86357 



1 N52849654 

2 E107452749 

3 1075382657 

4 63956272651 

5 20756 



1 M3474638 

2 E385638361 

3 6120346246 

4 01852954752 

5 65820 



1 N01472863 

2 E184644278 

3 1038565275 

4 07452865375 

5 15832 



1 N86612086 

2 S68 1902642 

3 1943028474 

4 02857918491 

5 65821 



1 N 10238475 

2 E027361S56 

3 7453298136 

4 08164829154 

5 68264 



1 N02746382 

2 E578103656 

3 5482107462 

4 10825483217 

5 62741 
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WEAPON Be : 



WEAPON Cl : 



WEAPON C2 : 



WEAPON C3 : 



WEAPON C4 : 



WEAPON C5 : 



N58286108 

E193656828 

1037561937 

18401746218 

51073 



N 10354826 

E102462651 

6295016472 

39741845226 

10275 



N 17494625 

E629575107 

4610374628 

10817381561 

19565 



N56194015 
E4528 08462 
9108265726 
51072658254 
75382 



N01735473 

E107562743 

1658264634 

51956271064 

61028 



N 10741970 

E963557254 

5629601652 

51036582514 

62814 



N86952753 

S106385672 

1653903647 

01758265781 

01538 



1 

c 

3 

4 

5 

1 

2 

3 

4 

5 

1 

2 

'7 

o 

4 

c; 

1 

2 

4 

c; 

o 

1 

2 

3 

4 

5 

1 

2 

'X 

o 

4 

c 

1 

'7 

4 

Ps 



WEAPON C6 



APPENDIX F 



TAEGST INFORI^ATION VERIFICATICN TASK 
PRELOADED TARGET SETS 



Sumir.ary of #characters/i ine to be changed out: 



Seven hundred seventy-four total characters are possible 



10 


be c 


banged 


out 


in 


all 


18 


target 


sets . 


A V 


alue of 


10% 


was 


o 

o 


sen 


to be 


chan 


ged 


out 




ea ch s 


object. 


T 


en 


perc 


ent 


of 


774 


— rj 

— f 


8 , the 


nurr 


ber 


chos 


en 


to be 


changed 


out 


• 










All 


eight 


een 


target s 


ets 


were 


divided 


i nt 


c t 


hree 


grc 


)Ups 


Of 


SU 


targe i 


set 


s/dj 


• Splay rr, 


etbod. 


Each 


of t 


he 


three 


grc 


)ups 


had 


26 


charac 


t ers 


tc 


be 


ch 


anged 


out . 


Cha 


rac 


ters 


tc 


be 


cha 


nged 


out w 


ere 


selected 


randomly 


• 




























#Charac 


ters 


/li 


ne to 







be changed out : 



WEAPON A1 ; 1 N 02746382 5 

2 Et7ei03856 0 

3 5482107462 1 

4 10825483217 0 

5 62741 0 

1 N 10354826 1 

2 E 102462651 1 

3 6295016472 0 

4 39741845226 1 

5 10275 0 



WEAPON A2 : 



WEAPON 



WEAPON 



WEAPON 



WEAPON 



WEAPON 



WEAPON 



#Characiers/l ine to 
be changed out: 



A3 ; 1 


Ne265y374 


0 


2 


E£98326188 


5 




3871946572 


'X 


4 


£8386610664 


0 


5 


18452 


0 



A4 : 1 


N31864725 


0 


c. 


E467214085 


0 




1965430873 


1 


4 


97031687439 


2 


5 


61496 


0 



A5 : 1 


N 13474638 


1 


2 


E385636361 


2 


•7 


6120346246 


1 


4 


01852954752 


1 


5 


65620 


1 



A6 : 1 


N01472863 


0 


c 


E184644278 


0 


•X 


1038565275 


0 


4 


07452865375 


0 




15832 


0 



B1 : 1 


N 17494625 


1 


c 


E629575107 


0 


'X 


4C1037462S 


2 


4 


10817381561 


0 


5 


19565 


0 



B2 ; 1 


N56672130 


1 


2 


S120957264 


2 


3 


1295725482 


0 


4 


07362756364 


1 


5 


28158 


0 



8? 



ffCharacters/1 ine to 
be .changed out : 



WEAPON B3 ; 1 N 10238475 2 

2 E027361656 7 

3 7453298136 0 

4 08164829154 0 

5 68264 0 

WEAPON B4 ; 1 N66952753 0 

2 E106385672 0 

3 1653903647 1 

4 01758265761 1 

5 01538 2 

WEAPON B5 : 1 N17494625 1 

2 E629575107 0 

3 4610374628 2 

4 10817381561 0 

5 19565 0 

WEAPON E6 : 1 N 19857435 3 

2 E973667525 0 

3 1210934753 0 

4 53272361071 0 

5 40912 0 

WEAPON B7 : 1 N 17896354 1 

2 E194653853 6 

3 5481937906 2 

4 64868351041 0 

5 66357 0 

WEAPON B8 ; 1 N58266108 4 

2 E193656828 1 

3 1037561937 0 

4 16401746216 0 

5 51073 0 
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#Characters/line to 
be changed out : 



WEAPON Cl ; 1 


N 01472863 


0 


2 


E164644276 


0 


rz 


1038565275 


0 


4 


07452865375 


0 


c; 


15832 


0 



WEAPON C2 : 1 


N 10725497 


2 


2 


E726552547 


1 


'X 


1S50724572 


0 


4 


75189473575 


0 


5 


26836 


3 



WEAPON C3 : 1 


N52849654 


0 


2 


E107452749 


1 


3 


1075382657 


0 


4 


63956272651 


0 


5 


20756 


0 



WEAPON C4 : 1 


N56194015 


0 


2 


E452806462 


2 


T 


9108265726 


0 


4 


51072658254 


0 




75382 


3 
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APPINDIX G 



REVISED lARGET SETS TO EE UPDATED IN PART II 
TARGET INEORMATION VERIEICATICN TASK 
SINGLE-SPACED DISPLAY EORf^AT 



WEAPON A1 ; 



WEAPON A2 : 



WEAPON A3 ; 



WEAPON A4 : 



WEAPON A 5 : 



WEAPON A6 : 



1 N073423y4 

2 E578l03fcE6 

3 5082107462 

4 10825483217 

5 62741 



1 N 10254826 

2 E102462671 

3 6295016472 

4 09741845226 

5 10275 



1 N82659374 

2 E758826381 

3 3773946571 

4 28366610864 

5 18452 



1 N31664725 

2 E467214085 

3 1965430473 

4 92001687439 

5 61498 



1 N 13404638 

2 E185638371 

3 5160346246 

4 01852854752 

5 35620 



1 N01472663 

2 E184644276 

3 1038565275 

4 07452665375 

5 15832 
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DOUBLE-SPACED DISPLAY F05MAT 



WEAPON B1 ; 



WEAPON B2 : 



WEAPON B3 : 



WEAPON B4 : 



WEAPON B5 : 



WEAPON B6 : 



N176946i;5 

E629575107 

4610375676 

10617381561 

19565 



N56672630 

E022957264 

1295725482 

07362756314 

26156 



N 16236375 

E175340833 

7453298136 

08164829154 

66264 



N86952753 
S 106385672 
1253903647 
01758265081 
21548 



N 17694625 

E629575107 

4610375678 

10817381561 

19565 



N 15667495 

E973687525 

1210934753 

53272361071 

40912 



1 

2 

3 

4 

5 

1 

2 

4 

1 

2 

■7 

4 

1 

2 

3 

4 

5 

1 

2 

”7 

4 

c; 

w 

1 

2 

4 

t; 



INVERSE-VIDEO DISPLAY EOHrAT 



WEAPON B7 ; 



WEAPON E8 : 



WEAPON Cl : 



WEAPON C2 : 



WEAPON C3 : 



WEAPON C4 : 



1 N77896354 

2 E990353146 

3 5421937106 

4 64866351041 

5 86357 



1 N57486001 

2 E196656628 

3 1037561937 

4 18401746218 

5 51073 



1 N01472863 

2 E 184644278 

3 1038565275 

4 07452865375 

5 15832 



1 N 17724497 

2 E828552547 

3 1850724572 

4 75189473575 

5 29637 



1 N 52849654 

2 E109452749 

3 1075382657 

4 63956272651 

5 20756 



1 N56194015 

2 E852808461 

3 9108265726 

4 51072658254 

5 77689 
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APPENEIX H 



EXPERII^ENTAL EATA 
TABLE VIII 

SUBJECT ERRORS - TARGET LOAEING TASK 

(IKB) 



SUE .# 


1 NIC 


1 NEC 


NICE 


1 NMC 


! NCE 


1 

I 


TNE \% 


; CORRECT 


ENTR . 


1 


! 0 


1 y 


9 


1 2 


! 1351 


1 

1 


1361 j 


%97.6 


1 

1 


2 


1 0 


\ 44 


0 


1 0 


i 1316 


1 

1 


1446 1 


%90 .9 


1 

1 


3 


1 0 


1 6 


6 


1 1 


1 1354 


1 

1 


1378 1 


%98.2 


1 

1 


4 


! 46 


1 


51 


1 46 


1 1309 


1 

1 


1375 ! 


%91 .9 


1 

1 


c. 


1 0 


\ 6 


6 


1 0 


I 1352 


I 

1 


1444 1 


%93.6 


1 

1 


6 


1 t. 

1 ^ 


! 7 


10 


i 3 


1 1350 


1 

1 


1376 1 


%97.9 


I 

1 


7 


! 0 


! 6 


6 


! 0 


! 1354 


1 

1 


1371 1 


%96.6 


1 

1 


S 


! 43 


1 2 


45 


1 45 


1 1315 


1 

1 


1366 ! 


%93.2 


1 

1 


9 


! 2 


! 10 


12 


1 27 


1 1346 


1 

1 


1399 1 


%94.5 


1 

1 


10 


! 5 


1 


10 


1 0 


j 1350 


1 

1 


1366 1 


%97.4 


1 

1 


11 


! 0 


i 1 


1 


1 0 


1 1359 


1 

1 


1362 1 


%99.e 


1 

1 


12 


! 47 


1 


62 


1 90 


1 1296 


1 

I 


1374 1 


%86,7 


1 

1 


13 


! 0 


1 4 


4 


! 0 


1 1356 


1 

1 


1366 1 


%99.1 


1 

1 


14 


! 2 


1 Tt 

I ^ 




1 0 


! 1355 


1 

1 


1394 1 


%97.2 


1 

1 


15 


1 0 


1 22 


22 


! 0 


! 1338 


I 

1 


1436 ! 


%93.0 


1 

1 


16 


1 36 


! 17 


53 


! 46 


i 1307 


1 

1 


1390 1 


%91 .0 


1 

1 


17 


! 0 


i 1 


1 


! 0 


I 1359 


1 

1 


1362 1 


%96.6 


1 

1 


16 


! 1 


! ^ 


7 


! 0 


1 1353 


1 

1 


1361 ! 


%96.0 


1 

1 


19 


1 19 


\ t 


27 


1 17 


I 1333 


1 

1 


1369 ! 


%94.8 


1 

1 


20 


! 0 


! 8 


e 


! 0 


i 1352 


1 

1 


1363 1 


%97.8 


1 

1 



LEGEND: 



NIC: Nutrber Incorrect Characters 
NEC: Nuirher Entries Corrected 
NICE: Numoer ci‘ Incorrect Entries = NIC + NSC 
NNC: Number Missing Characters (same as NME) 
NCE: Number Correct Entries 
TNE: Total Number Errors 
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TABLI IX 



SUBJECT ERROES : TARGET LOADING TASK 



(VOICE) 



SUB.# 


1 NIC 


1 NEC 


1 NICE 


i NMC 


1 NCE 


1 

1 


TNE !% CORRECT 


ENTR. 


1 


1 1 


1 4 


1 39 


i 0 


1 1321 


1 

1 


1368 ! 


%99.0 


1 

1 


2 


1 2 


1 19 


i 60 


1 T 


1 1300 


1 

1 


1412 1 


%91.6 


1 

1 


3 


I 1 


! 17 


j T4 


1 0 


j 1286 


1 

1 


1413 1 


%91 .0 


1 

1 


4 


1 4 


1 T 


! 49 


1 2 


1 1311 


1 

J 


1398 1 


%93.6 


1 

1 


5 


1 <7 

1 ^ 


I 21 


1 T3 


! 3 


i 128T 


1 

1 


1442 1 


%69.0 


1 

\ 


e 


! 8 


! 6 


j 4T 


! T 


I 1313 


1 

I 


1392 1 


%93.9 


1 

1 


7 


1 '7 

1 ^ 


1 29 


I 60 


1 0 


1 1310 


1 

1 


1420 1 


%92.3 


1 

1 


S 


1 1 


! 10 


1 32 


1 45 


1 1349 


1 

1 


1408 1 


%92.8 


1 

1 


y 


! 0 


1 IT 


! 81 


1 2 


1 12T9 


1 

1 


1430 1 


%89.3 


1 

1 


10 


1 4 


1 23 


! SI 


! 0 


1 1309 


1 

1 


1440 1 


%90 .9 


1 

1 


vii 


1 1 


1 21 


1 81 


! 0 


1 12T9 


1 

1 


1418 1 


%90.2 


1 

1 


12 


1 0 


! 18 


1 44 


1 0 


I 1316 


1 

1 


1399 j 


%94.1 


1 

1 


^13 


1 e 


! c 

1 ^ 


1 41 


I 45 


1 1319 


1 

1 


1378 1 


%92.7 


1 

1 


14 


1 1 


1 5 


1 22 


! 0 


i 1338 


1 

1 


1392 1 


%96.1 


1 

1 


’^15 


! T 


1 43 


I 89 


! 10 


1 1271 


1 

1 


1449 1 


%87.1 


1 

1 


16 


1 9 


! IT 


1 108 


1 0 


1 1252 


1 

1 


1444 j 


%ee.7 


1 

1 


^17 


I 3 


j 2T 


1 118 


1 0 


1 1242 


1 

1 


1436 1 


%86.5 


1 

1 


18 


t R 


! IS 


! 41 


i 10 


1 1319 


I 

1 


1400 ! 


%93.5 


1 

1 


^19 


1 1 


1 9 


1 TR 

1 w 


1 0 


1 1325 


1 

1 


1391 j 


%95.3 


1 

1 


20 


! 14 


1 38 


1 110 


1 9 


1 1250 


1 

1 


1449 ! 


%B5.7 


1 

1 



LEGEND; 



NIC: Number Incorrect Cbaracters 
NEC; Nurtber Entries Corrected 
NICE: Nurber of Incorrect Entries = NIC + NEC 
NMC; Nurrber Missing Characters (sarre as NME) 
NCE; Humber Correct Entries 
TNE: Total Number Errors 
^ : Previous Experience with Voice Input 



(The voice portion of NICE also includes the number 
of voice unit ncnrecognitions and missrecogni tions ) 
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TABLE X 



SUBJECT EEEOES: TAEGET INFOEMATION VEEIi; I CATION TASK 



(SINGLE-SPACED ECEMAT ) 



SUB .# 


NIC 


NEC ! 


MCE 


NMC 


1 NCE 


! TNE 1 


% CCEEECT 


ENTE. 


1 


p; 


0 I 




1 


1 125 


! 130 1 


%95.4 


1 

1 


* 1 


0 


0 1 


0 


0 


1 130 


1 130 ! 


%100.0 


1 

1 


'7 

t-r 


0 


0 ! 


0 


1 


1 130 


! 132 ! 


%97.7 


I 

1 


4 


0 


n 1 

ij 1 


0 


0 


! 130 


1 130 1 


%100.0 


1 

1 


Pn 


4 


1 1 


c; 

w 


0 


1 117 


1 130 1 


%90 .0 


1 

1 


6 


0 


e ! 


1 


1 


1 129 


! 130 1 


%98.5 


1 

1 


7 


0 


0 j 


0 


0 


1 130 


1 132 1 


%98.5 


1 

1 


8 


1 


0 ! 


1 


0 


! 129 


1 130 I 


%92.3 


1 

1 


9 


0 


0 ! 


0 


0 


1 130 


1 130 1 


%100.0 


1 

1 


10 


0 


1 1 


1 


0 


! 129 


1 132 ! 


%97.7 


1 

! 


11 


0 


6 ! 


6 


1 


i 124 


1 145 1 


%84.9 


1 

1 


12 


0 


0 ! 


0 


0 


1 130 


1 130 j 


%100.0 


1 

1 


13 


0 


1 1 


1 


0 


1 129 


1 132 I 


%97.7 


1 

1 


14 


4 


1 1 


5 


0 


i 125 


1 132 ! 


%S4.7 


1 

1 


15 


0 


3 I 


3 


0 


1 127 


1 150 1 


%84.6 


1 

1 


16 


0 


1 1 


1 


1 


1 129 


! 138 I 


%92.e 


1 

1 


17 


2 


2 1 


4 


0 


1 126 


1 132 1 


%95.5 


1 

1 


18 


0 


0 1 


0 


0 


1 130 


1 130 ! 


%100.0 


1 

1 


19 


0 


0 1 


0 


0 


1 120 


! 132 1 


%98.5 


1 

1 


20 


1 


0 1 


1 


1 


1 129 


1 130 ! 


%98.5 


1 

1 



LEGEND: 



NIC: Nuir.der Incorrect Characters 
NSC: Nutrber Entries Corrected 
NICE: Nurrber cf Incorrect Entries = NIC NEC 
NMC: Nurber P’issing Characters (saire as NME) 
NCE: Nunber Correct Entries 
TNE: Total Number Errors 
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TABLZ XI 



SUBJECT ERBORS; TARGET INFORMATION VERIFICATION TASK 



(DOUBLE-SPACEE iORMAT) 



SUB.# 


NIC 


NEC ! 


NICE 


NMC 


! NCE 


1 

1 


TNE ! 


% CORRECT 


ENTR. 


1 


0 


4 1 


4 


1 


1 128 


1 

1 


141 ! 


%99.1 


1 

1 


2 


0 


0 1 


0 


e 


i 132 


1 

1 


136 ! 


%97.1 


1 

1 


'T. 


1 


1 


6 


0 


i 126 


1 

1 


141 ! 


%89.4 


1 

1 


4 


5 


0 1 


5 


0 


1 127 


1 

1 


132 1 


%96.2 


1 

1 


b 


0 


0 ! 


0 


0 


! 132 


1 

1 


132 I 


%100.0 


1 

1 


e 


2 


1 I 


3 


0 


1 129 


1 

1 


134 ! 


%96.3 


1 

1 


7 


0 


1 1 


1 


0 


I 131 


1 

1 


134 1 


%97.8 


1 

1 


e 


1 


0 I 


1 


0 


1 131 


1 

1 


134 1 


%96.3 


1 

1 


9 


1 


3 ! 


4 


0 


1 126 


1 

1 


138 ! 


%92.8 


1 

1 


le 


1 


1 j 


2 


1 


1 130 


1 

1 


134 ! 


%96.3 


1 

1 


11 


0 


1 ! 


1 


1 


1 131 


1 

1 


134 1 


%97.0 


1 

1 


Ik 


0 


*7 1 

w 1 


3 


0 


1 129 


1 

1 


134 1 


%96.3 


1 

1 


13 


1 


1 ! 


2 


1 


1 130 


1 

1 


138 I 


%93.5 


1 

1 


14 


3 


1 I 


4 


1 


1 128 


1 

I 


144 ! 


%S8.3 


1 

I 


15 


0 


1 ! 


1 


1 


I 131 


1 

1 


137 1 


%94.9 


1 

1 


16 


1 


4 i 


5 


2 


1 127 


1 

1 


140 ! 


%69.4 


1 

1 


17 


0 


3 1 


w 


1 


i 129 


1 

1 


147 1 


%87.2 


1 

1 


18 


1 


"Z 1 

^ 1 


4 


0 


i 128 


1 

1 


137 1 


%93.4 


I 

1 


19 


1 


2 1 


3 


0 


1 129 


1 

1 


136 ! 


%94.9 


1 

1 


10 


0 


3 I 


3 


0 


1 129 


1 

I 


138 ! 


%93.5 


1 

1 



LEGEND; 



NIC : 


Number 


Inc crrec 


1 


Characters 




NEC: 


Number 


Entries 


c 


orre 


oted 




NICE: 


Number 


of I n c 0 r 


r 


eci 


Entries = NIC 


+ NEC 


MMC; 


Num ber 


Missing 


C 


ha ra 


cters (same as 


NME) 


NCE: 


Number 


Correct 


V 

j-i 


ntri 


es 




TNE ; 


Total 1 


Number Er 


r 


ors 
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TABLE XII 



SUBJECT EEBORS: TARGET iNFCRr^ATION VERIFICATION TASK 



(INVERSE-VIDEO iORMAT) 



SUB.# 


! NIC 


NSC 


MCE 


NMC 


1 NCE 


I TNE 1 


% CORRECT 


ENTR. 


1 


1 z 


0 


0 


0 


1 115 


1 115 ! 


%100 .0 


1 

1 


2 


1 0 


0 


0 


0 


1 115 


121 ! 


%95.0 


1 

1 


3 


1 0 


0 


0 


0 


1 115 


i 115 ! 


%100.0 


1 

1 


4 


1 0 


0 


0 


3 


1 115 


1 115 1 


%97.5 


1 

1 


5 


1 T 


0 


7 


0 


1 108 


1 115 ! 


%93.9 


1 

1 


6 


1 0 


0 


0 


2 


1 115 


! 115 1 


%98.3 


1 

\ 


7 


1 0 


1 


1 


0 


! 114 


1 125 1 


%91 .2 


1 

1 


e 


1 0 


0 


0 


0 


1 115 


I 115 I 


%100.0 


1 

1 


y 


1 0 


1 


0 


0 


i 114 


I 117 1 


%97.4 


1 

1 


10 


1 0 


2 


2 


0 


1 113 


1 119 i 


%95.0 


1 

1 


11 


! 18 


0 


18 


0 


i 97 


1 115 1 


%S4.3 


1 

1 


12 


I 




7 


0 


1 106 


1 115 ! 


%93.y 


1 

1 


13 


1 0 


7 


7 


0 


I 108 


1 121 ! 


%89.3 


1 

1 


14 


1 3 




4 


1 


1 111 


1 127 1 


%66.7 


1 

1 


It 


! 0 


0 


0 


0 


1 115 


1 118 1 


%97.5 


1 

1 


le 


1 9 


w 


12 


1 


1 103 


1 124 ! 


%82.4 


1 

1 


17 


i 2 


0 


2 


0 


I 113 


1 115 1 


%98.3 


1 

1 


le 


1 0 


0 


0 


0 


1 115 


1 115 ! 


%100.0 


I 

1 


19 


1 1 


2 


3 


0 


1 112 


1 120 i 


%93.3 


1 

1 


20 


1 1 


2 


1 


0 


1 114 


1 115 1 


%99.1 


1 

1 



LEGEND: 



NIC: NurrLer IncorrecL Cbaraciers 
NEC: Number Entries Corrected 
NICE: Number of Incorrect Entries = NIC + NEC 
NMC: Number Missing Characters (same as NME) 
NCE: Number Correct Entries 
TNE: Total Number Errors 



TABLE XIII 



ERRORS’!' LURING VOICE ENTRY 



SUB.# 






TARGET SETS 




1 TOTAL 






! 1-5 


1 

1 


6-10 


1 

1 


11-15 


1 16-20 






1 


' e 


1 

I 


6 


1 

1 


16 


I 10 


! 38 


1 

1 




1 IV 


1 

1 


19 


1 

1 


£3 


1 9 


! 68 


1 

1 


3 


1 14 


1 

1 


26 


1 

1 


21 


1 11 


! 72 


1 

1 


4 


1 V 


1 

1 


12 


1 

1 


13 


I 13 


1 45 


1 

1 


c; 


1 19 


1 

1 


IS 


1 

1 


18 


1 15 


1 70 


1 

1 


5 


I 9 


1 

1 


11 


1 

1 


8 


1 y 


! 37 


1 

1 


7 


1 12 


1 

1 


11 


1 

1 


6 


1 6 


1 9 


1 

1 


6 


! V 


1 

1 


y 


1 

1 


6 


1 7 


! 29 


1 

1 


9 


1 13 


1 

I 


18 


1 

1 


24 


1 26 


1 81 


1 

1 


10 


1 16 


1 

1 


7 


\ 

1 


10 


! 13 


! 46 


1 

1 


11 


1 12 


1 

1 


18 


\ 

1 


15 


1 14 


1 59 


1 

1 


12 


1 11 


1 

1 


9 


1 

1 


6 


1 y 


1 35 


1 

1 


13 


! 12 


1 

1 


'X 

«w/ 


1 

1 


11 


! 7 


1 33 


1 

1 


14 


1 4 


1 

1 


4 


1 

1 


2 


1 7 


1 17 


1 

1 


15 


1 13 


1 

1 


6 


1 

1 


7 


1 13 


1 39 


1 

1 


16 


1 6 


1 

1 


£9 


1 

1 


26 


1 17 


I 60 


1 

1 


17 


1 17 


1 

1 


17 


1 

1 


28 


1 26 


1 88 


1 

1 


18 


1 •’1 

1 ^ 


1 

1 


£ 


1 

1 


6 


1 y 


1 20 


1 

1 


19 


I 6 


1 

1 


9 


1 

1 


7 


! 3 


! 25 


1 

1 


22 


1 lii) 


1 

1 


10 


1 

1 




1 23 


1 48 


1 

1 


mean : 


I le .7 


1 

1 


12.5 


1 

1 


12.7 


! 13.0 






sd ; 


1 4.6 


1 

1 


7 .6 


1 

1 


7.8 


1 6.3 







Nc nrec cgni t i cns and. Misreccgni ti ons 
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TABLE XIV 



HECOGNITIGNS 


OF UTTERANCES BY 


ENTRY ITOTAL 


NONRECCGNITICNS 1 


G ! 


92 1 


1 1 


49 1 


2 ! 


86 I 


3 I 


31 1 


4 1 


127 1 


5 1 


62 1 


6 ! 


44 1 


T 1 


'7 o \ 

w dC 1 


s I 


40 1 


9 1 


24 1 


control 1 


^ C 1 


modify ' 


19 1 


enter 1 


69 ! 


yes ! 


4 j 


alpha 1 


6 ! 


dravo I 


16 ! 


Charlie 1 


0 1 


left 1 


17 1 


right ! 


'2 1 
C. I 







' 1 %. 

'•" IH! 




TABLE XV 

NONRECOGMITIONS Oi UTTERANCES BY SUBJECT 



SUB.: [TOTAL NONRECOGNITIONS! 


1 ! 


34 


1 

i 


2 1 


39 


1 

1 


3 ! 


P -7 

W 


1 

1 


4 1 


36 


1 

1 


1 

w 1 


48 


1 

1 


6 1 


23 


1 

1 


7 1 


16 


1 

1 


8 1 


16 


t 

1 


9 1 


63 


1 

1 


10 I 


20 


1 

1 


11 1 


53 


1 

1 


12 1 


23 


1 

1 


13 i 


27 


1 

1 


14 1 


15 


1 

1 


13 ! 


39 


1 

1 


16 1 


81 


1 

1 


17 ! 


60 


1 

1 


18 1 


20 


1 

1 


19 ! 


25 


1 

1 


20 ! 


56 


1 

1 



1C0 
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